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Abstract: 1 give a brief overview of the resolution of the apparent problem 
of reconciling time symmetric microscopic dynamic with time asymmetric 
equations describing the evolution of macroscopic variables. I then show 
how the large deviation function of the stationary state of the microscopic 
system can be used as a Lyapunov function for the macroscopic evolution 
equations. 



Gather ye rosebuds while ye may, 
Old time is still a-flying; 
And this same flower that smiles today, 
Tomorrow will be dying. 

Robert Herrick, 1591-1674 
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1 Time's Arrow 

Every bit of macroscopic matter is composed of an enormous number of 
atoms which act as quasi-autonomous units. Taking these atoms as classi- 
cal particles moving according to non-relativistic Hamiltonian equations the 
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complete microscopic (or micro) state of an isolated classical system of 
particles is specified by a point X in its phase space F, 



X = (ri, vi, ...rAT, vtv), 



eV cR", V, G R' 



d 



(1) 



and X{t) = (f)tX{0), where (pt is the evolution operator corresponding to the 
solution of the Hamiltonian equations of motion. These have the well known 
time reversal symmetry: setting, RX = (ri, — Vi, Fat, — v^v) then 



Suppose now that some property of the system, specified by a function 
f{X{t)), behaves in a particular way as t increases, then there is also a 
trajectory in which the property behaves in the time reversed way. Thus, for 
example, if particle densities get more uniform, say in a way described by 
the diffusion equation, then there will also be evolutions in which the density 
gets more nonuniform. So why is one type of evolution, corresponding to 
"entropy" increase in accord with the second "law" , common and the other 
never seen? 

This problem was clearly stated by W. Thomson (later Lord Kelvin) who 
wrote in 1874 [1]: 

"The essence of Joule's discovery is the subjection of physical phenomena 
to dynamical law. If, then, the motions of every particle of matter in the 
universe were precisely reversed at any instant, the course of nature would 
be simply reversed for ever after. The bursting bubble of foam at the foot 
of a waterfall would reunite and descend into the water; the thermal mo- 
tions would reconcentrate their energy, and throw the mass up the fall in 
drops re-forming into a close column of ascending water. ... And if also the 
materialistic hypothesis of life were true, living creatures would grow back- 
wards, with conscious knowledge of the future, but no memory of the past, 
and would become again unborn. But the real phenomena of life infinitely 
transcend human science; and speculation regarding consequences of their 
imagined reversal is utterly unprofitable." 

The explanation of this apparent paradox, due to Thomson, Maxwell and 
Boltzmann, is based on the great disparity between microscopic and macro- 
scopic scales — with the consequent exponentially large ratios between the 
number of microstates (phase space volume) corresponding to the different 
macrostates — and the fact that events are determined not only by differential 
equations, but also by initial conditions. These provide the ingredients for 
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the emergence of definite time asymmetric behavior in the observed evolution 
of macroscopic systems, despite the total absence of such asymmetry in the 
dynamics of individual atoms. (For a more detailed discussion and references 
see [2], [3].) 

1.1 Macrostates 

To describe the macroscopic state of a system of atoms in a box V, say 
TV > 10^°, we make use of a much cruder description than that provided by 
the microstate X. We shall denote by M(X) such a macroscopic description 
of a macrostate. As an example we may divide V into K cells, where K is 
large but still K <^ N , and specify the number of particles, the momentum 
and the amount of energy in each cell, with some tolerance. 

Clearly there are many X's (in fact a continuum) which correspond to 
the same M. Let Fm be the region in F consisting of all microstates X 
corresponding to a given macrostate M and denote by \Fm\ its Liouville 
volume. 

The equilibrium macrostate M^q is defined as that state for which l-TA/eql ~ 
\Fe\-, the area of the whole energy surface. When M{X) specifies a nonequi- 
librium state, |-rM(x)| is much smaller. Thus if the system contains atoms 
in a volume V then the ratio of l-T^/^gl, for the macrostate Mgg in which there 
are (| ± 10~^°)A^ particles in the left half of the box, to \Fm\ for a macrostate 
M in which all the particles are in the left half is of order 2^. For any macro- 
scopic value of A^, this is far larger than the ratio of the volume of the known 
universe to the volume of one proton. 

Boltzmann then argued that given this disparity in the sizes of Fm, 
\FM{X{t))\ will typically increase in a way which explains and describes the 
evolution towards equilibrium of isolated microscopic systems. 'Typical' here 
means that for any Fm the relative volume of the set of microstates X in Fm 
for which \og\FM[X{t))\ decreases by a macroscopic amount during some 
time period r, (no bigger than the age of the universe) goes to zero exponen- 
tially in the number of atoms in the system. 

^This is the reason why properties of an equihbriuni system, such as the fraction of 
particles in a given velocity domain can be obtained, for N ^ 1, as an average over the 
microcanonical ensemble. N.B. This does not depend on the system being ergodic in the 
mathematical sense as long as N is large enough. 
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2 Entropy and Lyapunov Function for Iso- 
lated System 

To make a connection with the Second Law of Clausius, Boltzmann defined 
the entropy of a macroscopic system with microstate X as 

Sb{X) = klog\rMix)\ (3) 

and showed that (for a dilute gas) in the equihbrium macrostate M^q, i.e. 
X G FMeq, Sb is equal (to leading order in N) to the thermodynamic entropy 
of Clausius. Following O. Penrose, I shall call fclog |/a/(^)| the Boltzmann 
entropy of a system in the macrostate M{X).We can make Boltzmann's 
argument quantitative if we suppose (assume) that the time evolution of Mt 
satisfies an autonomous deterministic equation, such as the Navier-Stokes 
equation or the Boltzmann equation. This means that if M^^ — >■ Mt^, then 
the microscopic dynamics carries /mj^ inside -^Mta' i-^- 4>t2-tirMt-^ C r^u^ 
with negligible error. The fact that phase space volume is conserved by 
the Hamiltonian time evolution implies that I-Ta/j | < I-Ta/^ | and thus that 

SBiMt,)>SB{Mt,)i0Th>t,. 

We have thus derived an '"H-theorem" or Lyapunov function for any 
deterministic evolution of the macro-variables arising from the microscopic 
dynamics of an isolated Hamiltonian system [3]. 

Example: For spatially uniform equilibrium systems the thermodynamic 
entropy is extensive 

S{E,-N,V) = Vs{e,n). (4) 
s(e, .) is a concave function of e. 

(9s 1 (9 1 (9T 

For systems in "local thermal equilibrium" (LTE) with local densities 
n{x), e(x), u(x) 

SB{n,u,e)= I s(e(x) - ^mn(x)u^(x),ra(x))dx = ^i.e (6) 
Jv ^ 

Consider now an isolated system in LTE (with u = and n constant) 
in a region V with boundary surface ^ and an energy density profile e(x) 
satisfying the macroscopic conservation equation 
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I^-V.I (7) 
where J(e) is the heat flux. When this is given by Fourier's law, 

J = -kVT, k{T) > 0. (8) 
we then have a closed autonomous equation for e or T. This yields, 



dt dt 

4 



V 



l^^{V-3)dx = - I lj.d5^ + ^J-(V;^)dx>0, 



(9) 



since J ■ d ^ = and k > 0. 

We next consider what happens when the isolated system is not in local 
equilibrium. (Following that we shall consider situations when the system is 
not isolated.) 

Following Boltzmann, we refine the thermodynamic M used for systems 
in LTE by noting that the microstate X = {rj,Vj}, i = 1,...,N, can be 
considered as a set of points in the six dimensional "/i-space". We then 
divide up this /^-space into J cells Aq, centered on (Fq,, Vq,), of volume |Aq|. 
A macrostate M is then specified by the number of particles in each Aq,, 

M = {Na}, a = l,...,J « N. (10) 

For dilute gases one can neglect, for typical configurations, the interaction 
energy between the particles. The coarse grained energy of the system in the 
state M is given, up to terms independent of /, by 

im^iV„v^ = i? (11) 

a 

with 

J2Na = N (12) 

The phase space volume associated with such an M is then readily com- 
puted to be 

\rj = U^{NJ)-'\AX'' (13) 
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Stirling's formula then gives 

Sb{M) ~ -4 5^ log ^) I A„| -ivj (14) 

V I d I I I ✓ 

Using M we can associate with a typical X a coarse grained density 

fx ~ Na/\l^a\ in /i-space, i.e. such that = J^^ (ix(iv/x(x, v). The Boltz- 

mann entropy is then given by 

Sb{X) = S,Uf) = -k [ [ dv/(x,v)log/(x,v) (15) 

Jv Jr^ 

The maximum of Sgas{f) over all / which satisfy the constraints, 

[ [ rfv/(x,v) = N (16) 
Jv Jn^ 

I d^ I rfv imvV(x, v) = E (17) 
Jv Jr3 2 

gives the equilibrium distribution, which is readily seen to be the Maxwell 
distribution 

/^^ = ^(27rA;T/m)-3/2exp[-mvV2A;T] (18) 
where kT = 2/3{E /N). In this case Sb coincides with the Clausius entropy 

5'gas(/e,) = SiE, N, V) = Nk[^ log T - log(iV/y)] + Const. (19) 

When / 7^ f^q then / and consequently 5'gas(/) will change in time. The 
second law, now says that typical X G Fj^j, at the initial time t = 0, will 
have an Mf = M{Xt) such that SBiM{Xt)) > ^B(M(XtO), for t > t'. This 
means that Sgas{ft) > 5'gas(/t')) for t > t'. This is exactly what happens for 
a dilute gas described by the Boltzmann equation for which 

—Sgas{ft) > 0, Boltzmann's "H— theorem (20) 

i.e. Sgas{f) is a Lyapunov function. 

As put by Boltzmann: "In one respect we have even generalized the 
entropy principle here, in that we have been able to define the entropy in a 
gas that is not in a stationary state" [4] . 
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Remark: It is important to distinguish between the empirical //-space 
density profile fxt (x, v) and another object with the same name, the marginal 
one-particle (probability) distribution -Fi(x, v, t) obtained from an A^-particle 
ensemble density evolving according to the Liouville equation. An instructive 
example is a macroscopic system of N noninteracting point particles, moving 
among a periodic array of scatterers in a macroscopic volume V. Starting 
with a nonuniform initial density fx^ (x, v) the time evolved fxt (x, v) will 
approach an / which depends only on |v| and which will have a larger Sgasif), 
while J J Fi logFi(ix(iv remains constant in time. The obvious evolution 
equation for fxt for this system, namely the one-particle Liouville equation, 
in fact does not describe the evolution of fxt for times after which -Fi(x, v, t) 
has developed structure on the microscopic scale. 



2.1 The Boltzmann Entropy of Dense Fluids Not in 
LTE 

Consider now the case when the interaction potential energy $ between the 
particles is not negligible. The region Fj^^ will then include phase points 
with widely differing total energies. The set of microstate X of a. system 
with a specified energy, H{X) = E will then correspond to a small fraction 
of Fj^^^j^y In fact a little thought shows that most of Fj corresponds to 
the largest energies compatible with /(x, v). The macrostate M specified by 
both / and E will then have a Boltzmann entropy consisting of a momentum 
part and a configurational part. For a system of hard spheres where E = K 
the Boltzmann entropy can be written as the sum, 

SUf) = S'^-\f) + Sthn) (21) 

where S^^^ is the momentum part 

^(-)(/) = -Jd^J f/v/(x,v)log[/(x,v)/n(x)] (22) 

V 

and Sj^] (n) is the configurational part of the entropy of an equilibrium system 
of hard spheres kept at a nonuniform density n(x) = J /(x, v)(iv by some 
external potential U (x) . 

Shsif) was proven by Resibois (in a different form) to be a Lyapunov 
function for the modified Enskog equation c.f. [3], 
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:rA{ft) > 




time 

The decrease of S^"^\ft) and increase of the total S{ft, E) is shown in Fig. 
1. Based on molecular dynamic simulations for different number of particles 
in a periodic box, Fig.l shows the time evolution of S'^'^\ of the potential 
and kinetic energies and of the total entropy S for a Lennard- Jones system 
started at t = in a state where the kinetic energy is "too high" [5] . This 
corresponds to a situation considered by Jaynes, c.f. [3]. 

3 Open Systems 

For an open system, say one in contact with a "heat bath" at a specified tem- 
perature T, the entropy of the system alone is clearly no longer an increasing 
function, e.g. we can start the system at an energy Eo corresponding to a 
temperature > T. In terms of the macroscopic equation for the energy 



(23) 
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density or temperature the entropy is no longer a Lyapunov function since 
the energy flux across the boundaries no longer vanishes, and can be either 
positive or negative. 

So what do we do for a Lyapunov function? 

A simple way which works for the case when there is only one heat bath 
is to observe that the total entropy production in system plus reservoir can 
be written as, see (9), 



dStotal dSie 



dl dt 



+ J^{l/f)3.dJ2 (24) 



|[^..e-(l/me]^|(-^) (25) 

J ■ V(;^)dx > (26) 

where J-", given by the terms in the square brackett in (25), is now the 
"Lyapunov function" . 

This procedure fails when the system is in contact with more than one 
heat bath and T is not constant on the boundary ^ in which case the entropy 
production is not zero in the stationary state. 

To proceed we now recall that, as noted by Boltzmann and Einstein, the 
relative Boltzmann entropy S{M) = Sb{M) — SsiMeq) is equal to the log of 
the probability of finding the system in the macrostate M = {e{x)}, 

P{M) ~ explSsiM) - SsiM,,)] = exp{-^(Af)} (27) 

This probability is with respect to the uniform (microcanonical) measure 
on the energy surface of the isolated system, which is stationary under the 
microscopic Hamiltonian time evolution. 

S{M) thus coincides, in the limit of large system size and M macro- 
scopically distinct from Mgg (the latter includes states which only differ by 
"normal" fluctuations) with the negative of the usual large deviation func- 
tional (LDF) of probability theory for fist{X) ~ 6{H{X) — E), i.e. for the 
microcanonical ensemble. 

The same is true for the Lyapunov function J-" for the system in contact 
with a single heat bath at temperature T, where 

J^{{e{x)}) = [E-fSi.e]/f (28) 
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is again the LDF of the stationary measure for the system in contact with a 
heat bath. This is now the canonical ensemble at temperature T. 

fist ~ exp[-H{X)/f] (29) 

The above analysis can be readily generalized to the macrostate M = 
{e(x), n(x), u(x)} whose time evolution is governed by the Navier-Stokes 
equations. In fact one expects that the LDF for the stationary measure 
will always be a Lyapunov function for the macroscopic equation [6, 7]. An 
example which exploits this fact to derive new Lyapunov functions is given 
in the next section[8]. 



4 Lyapunov function for a system in contact 
with several particle reservoirs 

Let 0" be a smooth increasing function. We consider the PDE on a regular 
domain ^ C 

^^ = V^(a(p(t,x))), (30) 

with Dirichlet boundary conditions on S specified by the reservoirs, i.e. 
p{t, x) = p{x) for X G S where p(x) is the stationary profile in all of V. 
Let 



Fuiv)= / dz log ^ (31) 
(t{u) 



We define the functional 



^(a) = / c/xF,)((t(x)). (32) 
Jv 

A straightforward but lengthy computation then shows that ^'^Jf^ > 
where we used the fact that on the boundary = 1. 

The function J-" defined in (32) is the LDF for the "zero range process" 
in contact with particle reservoirs at different densities. For this model the 
NESS is known explicitely and thus permits the explicit computation of the 
LDF [8]. 

The same computation will go through with a field 
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= VV(p(t, x)) - EVaipit, x)). (33) 

One could also treat mixed Dirichlet /Neumann boundary conditions. 

I thank the organizers of this conference for a wonderful meeting. Much of 
the work desribed here was done jointly with S. Goldstein. Work supported 
by NSF grant DMR08-02120 and AFOSR grant AF-FA 09550-07. 



References 

[1] W. Thomson, The Kinetic Theory of the Dissipation of Energy, Proc. 
Royal Soc. of Edinburgh, 8, 325 (1874). 

[2] J.L. Lebowitz, From Time- Symmetric Microscopic Dynamics to Time- 
Asymmetric Macroscopic Behavior: An Overview", Boltzmann's 
Legacy. 63-89, (2007). Los Alamos 0709.0724 

[3] S. Goldstein and J.L. Lebowitz, On the Boltzmann Entropy of Nonequi- 
librium Systems, Physica D, 193, 53-66 (2004) 

[4] L. Boltzmann, Vorlesungen iiber Gastheorie 2 vols. Leipzig: Barth, 1896, 
1898. This book has been translated into English by S.G. Brush, Lectures 
in Gas Theory, Cambridge University Press, London, (1964). 

[5] P. Garrido, S. Goldstein and J.L. Lebowitz, The Boltzmann Entropy of 
Dense Fluids Not in Local Equilibrium, Phys. Rev. Lett., 92, 050602, 
(2003) 

[6] W. De Roeck, C. Maes and K. Netocny, H-Theorems from Macroscopic 
Autonomous Equations, J. Stat. Phys., 123, 571-584, (2006) 

[7] L. Bertini, A. De Sole, D. Gabrielli, G. Jona-Lasinio and C. Landim, 
Macroscopic Fluctuation Theory for Stationary Non-Equilibrium States, 
J. Stat. Phys, 141, 635-675, 2002 

[8] T. Bodineau, J.L. Lebowitz, C. Mouhot and C. Villani, in preparation 



11 



